Image editing method, image editing device, and computer readable medium for storing image editing program

ABSTRACT

An image editing method comprises: a step of acquiring identification information on each of a plurality of operation instruction units for instructing editing of an image, a step of automatically selecting one or more images for editing from a group of images to classify the one or more images into a group of usable images based on the identification information, a step of determining a right to edit reaching contents of processing which each operation instruction unit is authorized to perform against each image in the group of usable images, and a step of performing editing processing on an image to be edited in the group of usable images based upon the determined right to edit according to an editing instruction supplied from each operation instruction unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of and claims benefit to U.S.patent application Ser. No. 13/950,206, filed Jul. 24, 2013 and entitled“IMAGE EDITING METHOD, IMAGE EDITING DEVICE, AND COMPUTER READABLEMEDIUM FOR STORING IMAGE EDITING PROGRAM”, which is a continuation ofU.S. patent application Ser. No. 12/569,947, filed Sep. 30, 2009, issuedas U.S. Pat. No. 8,499,242 and entitled “IMAGE EDITING METHOD, IMAGEEDITING DEVICE, AND COMPUTER READABLE MEDIUM FOR STORING IMAGE EDITINGPROGRAM,” which claims priority to JP Application No. 2008-253712, filedSep. 30, 2008 and entitled “IMAGE EDITING METHOD, IMAGE EDITING DEVICE,AND COMPUTER READABLE MEDIUM FOR STORING IMAGE EDITING PROGRAM”. Theentire contents of the documents cited in this specification areincorporated herein by reference.

BACKGROUND

The present invention relates to an image editing device and methodconfigured to edit and make browsable image data, and more specificallyto an image editing device and method that enable a plurality ofoperators to edit image data simultaneously and to a computer readablemedium storing a program for executing the image editing method.

In recent years, various image editing systems have been proposedwhereby some image data are included in the same electric album, andedited and saved so that a plurality of operators can share and browsethe data. With such a system, there has also been proposed a method fora plurality of operators to perform their own desired edits on an album,the same image data in the album, and the like.

JP 10-232946 A, for example, describes an image processing device andmethod, whereby images to be arranged in a template are placed in animage list window on the right-hand side of a screen for an operator toselect images of the favor in order to edit the album. The operatorselects an image of the favor from the image list window and drags anddrops the image with a mouse into an image selection window displayed onthe left-hand side of the screen to have the selected image positionedin a desired order on a desired page.

For example, JP 3196897 B discloses an image printing apparatus thatenables a plurality of operators to edit a common image. This apparatushas a plurality of image editing means corresponding respectively to aplurality of display screens so that the plurality of operators can usedifferent display screens and editing means to perform different editingoperations on a photographic image.

JP 2006-221494 A describes an image editing system for arranging imagessuch as photographs and digital images such as characters in a desiredformat. Operators are given different rights to access the arrangedimages so that they may lay out the images their own ways for adesirable appearance.

However, according to the method described in JP 10-232946 A, whereby animage is selected from among a group of images displayed in a singledisplay screen and moved to the image selection window, if a pluralityof operators should try to edit the same image simultaneously,instructions given by the operators for selecting an image and arrangingthe image in a template conflict with each other so that the operatorscannot locate their selected image in a desired position. In addition,the movements of the image and mouse pointers on the screen becomecomplicated so that the operators cannot recognize their own processingon the screen, making operations such as a drag-and-drop difficult andreducing the ease of operation.

For example, if the operators simultaneously give instructions, aplurality of mouse pointers are displayed on the screen, and a pluralityof images are dragged and dropped at the same time, which makes themovements on the screen complicated and makes smooth operationsimpossible.

According to the apparatus described in JP 3196897 B, the number ofscreens provided must be increased accordingly as the operatorsincrease. Further, if a plurality of operators should try to edit thesame image by modifying the same part thereof, a particular figure isdisplayed automatically, and thus none of the operators can accomplishtheir intended editing in that part.

Although the image editing system described in JP 2006-221494 A maypermit editing as desired by one of the operators by granting a right toaccess a single image data. This, however, requires manual allocation ofrights to access for each image data and thus reduces operationperformance.

Thus, conventionally, should a plurality of operators try to edit thesame object simultaneously, a first operator trying to change thebackground color of an album, a second operator trying to enlarge animage about his/her own face or cut it out, a third operator trying toadd comments to the image, a fourth operator trying to turn the imagesepia, and so forth, then either these operations do not produce anyintended changes or a plurality of editing instructions conflict witheach other, making the movements on the screen complicated, and eachoperator cannot perform their individual editing operation on the sameobject at a time, which reduces operation performance for each operator.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to solve the aboveproblems associated with prior art and provide an image editing methodand device as well as a computer readable recording medium storing aprogram for executing the image editing method, whereby a plurality ofoperators can each perform their desired editing operations easily withan enhanced operation performance without having difficulties inoperation and without conflicts of their editing processing on thescreen among the operators when the plurality of operators edit the sameimage data simultaneously.

An image editing method according to the present invention comprises: astep of acquiring identification information on each of a plurality ofoperation instruction units for instructing editing of an image, a stepof automatically selecting one or more images for editing from a groupof images to classify the one or more images into a group of usableimages based on the identification information, a step of determining aright to edit reaching contents of processing which each operationinstruction unit is authorized to perform against each image in thegroup of usable images, and a step of performing editing processing onan image to be edited in the group of usable images based upon thedetermined right to edit according to an editing instruction suppliedfrom each operation instruction unit.

An image editing device according to the present invention comprises: aplurality of operation instruction units for instructing editing ofimage data, the operation instruction units having their respectiveidentification information, an operator recognition unit for acquiringidentification information of each of the operation instruction units,an image selection unit for automatically selecting one or more imagesfor editing from a group of images to classify the one or more imagesinto a group of usable images based on the identification information,an editing authorization unit for determining a right to edit reachingcontents of processing which each operation instruction unit isauthorized to perform against each image in the group of usable imagesselected by the image selection unit, and an editing processor forperforming editing processing on an image to be edited in the group ofusable images based upon the determined right to edit determined by theediting authorization unit according to an editing instruction suppliedfrom each of the operation instruction units.

A computer readable medium according to the present invention is oneconfigured to store a program for executing on a computer, the programcomprising: a step of acquiring identification information on each of aplurality of operation instruction units for instructing editing of animage, a step of automatically selecting one or more images for editingfrom a group of images to classify the one or more images into a groupof usable images based on the identification information, a step ofdetermining a right to edit reaching contents of processing which eachoperation instruction unit is authorized to perform against each imagein the group of usable images, and a step of performing editingprocessing on an image to be edited in the group of usable images basedupon the determined right to edit according to an editing instructionsupplied from each operation instruction unit.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of an imageediting device according to an embodiment of the present invention.

FIG. 2 illustrates an example of recognition information used in theembodiment.

FIG. 3 schematically illustrates a method of selecting images forarrangement.

FIG. 4 is a flowchart illustrating an image editing method according tothe embodiment.

FIG. 5A illustrates an image to be edited.

FIGS. 5B to 5D illustrate editing processings that operators arerespectively authorized to perform according to the embodiment.

FIG. 6 is a flowchart illustrating how a right to edit is determinedaccording to the embodiment.

DETAILED DESCRIPTION OF THE INVENTION

The following describes in detail the preferred embodiments of the imageediting device and the image editing method according to the presentinvention referring to the accompanying drawings.

FIG. 1 illustrates a configuration of an image editing device 10according to an embodiment of the present invention.

The image editing device 10 comprises a plurality of operationinstruction units 12, an operator data storage unit 14, an operatorrecognition unit 16, an image storage unit 18, an image selection unit20, an editing authorization unit 22, an editing processor 24 and amonitor 26.

The operation instruction units 12 give instructions for arrangements ofimages in an album and image editing operations. Operators use theirrespective operation instruction units 12 to select images and locatethem in positions in the album.

Each operation instruction unit 12 may be any known operationinstruction means as exemplified by a remote controller using infraredcommunication, a mouse of a personal computer, a keyboard, a touch pen,and a touch panel.

The operation instruction units 12 contain their respectiveidentification information unique thereto. The identificationinformation may be identification data previously stored in theoperation instruction units 12. An operator operates the correspondingoperation instruction unit 12 to transmit instruction information forimage editing and identification information associated therewith to theoperator recognition unit 16 to request editing of the album.Specifically, an operator refers to an image displayed on the monitor26, decides on the contents of editing to make in the image in thealbum, uses the operation instruction unit 12 to transmit identificationinformation to the operator recognition unit 16 and gives an editinginstruction.

The identification of an operator may be achieved by transmitting theidentification information from the operation instruction unit 12 or,alternatively, each operator may have his/her operation movementpreviously stored as operation pattern in the operation instruction unit12 or the operator recognition unit 16 so that reproduction of theoperator's stored operation pattern movement may permit identificationof the operator.

This makes it possible to determine which operator is giving whichinstruction, even when a plurality of operators give operationinstructions about the same image data in the album. This will bedescribed later in detail.

The operator data storage unit 14 is a data base storing information onthe plurality of operators.

The operator data storage unit 14 has previously registered thereinoperator identification data and/or face images as recognitioninformation for recognizing the operators. This information can be addedand updated as necessary. The recognition information is used for theoperator recognition unit 16 to determine the operator and for the imageselection unit 20 and the editing authorization unit 22 described laterto perform processing.

FIG. 2 illustrates an example of recognition information stored in theoperator data storage unit 14.

In this embodiment, the recognition information uses an operator'sidentification data, face image data, preferred image keywords, etc. Therecognition information is previously registered and stored in theoperator data storage unit 14 separately for each operator.

The operator identification data is unique to each operator and isautomatically set in the operator data storage unit 14 in associationwith the identification information supplied from the operationinstruction unit 12.

An operator's face image is used for the image selection unit 20 toautomatically select a group of images that can be arranged by thatparticular operator or for the editing authorization unit 22 todetermine the right to edit for an image, contents of editing, and thelike that each operator is authorized to perform. Image selection anddetermination of the right to edit will be described later in detail.

Two or more face images may be registered for each operator. In thiscase, the face images are prioritized. Examples of standards by whichthe images may be prioritized include images of the face directedfrontward, images taken recently, images taken on a date closer to thatof the image to be compared, images of a face size greater than a giventhreshold, and images of a quality better than a certain level. Thepriority may be set so that those images that enable comparison withgreater accuracy are given higher priority.

The preferred image keywords related to an operator's preferred imagesare also registered. A registered keyword may be, for example, “flower”if the operator likes flowers or “car” if the operator likes cars. Theregistered keyword need not be the name of an object, but may be a colorsuch as “red” or “blue,” or a scenic backdrop such as “night scene.”

The operator recognition unit 16 recognizes the operators operatingtheir respective operation instruction units 12 according to theidentification information for the operation instruction units 12 andthe recognition information stored in the operator data storage unit 14.

Upon request for editing of the album by an operation instruction unit12, the operator recognition unit 16 acquires recognition informationcorresponding to the identification information received from theoperation instruction unit 12 from among the recognition information onthe operators stored in the operator data storage unit 14.

Further, the operator recognition unit 16 transmits the acquiredrecognition information to the image selection unit 20.

Where the operation instruction units 12 are owned by operators uniquethereto, the operator identification data as recognition information maybe used as identification data unique to the individual operationinstruction units 12 of their respective operators. However, theinvention is not limited thereto. Operation instruction unitidentification data unique to each operation instruction unit 12 andoperator identification data of the operator who uses the operationinstruction unit 12 may be stored in combination or in association witheach other in the operator data storage unit 14 as identificationinformation so that when the operator uses the operation instructionunit 12, the relevant operator identification data may be specifiedbased upon the operation instruction unit identification data receivedfrom the operation instruction unit 12 and the operator recognition unit16 may recognize the operator. Alternatively, the operatoridentification data may be entered directly or read by a bar codereader, for example, to recognize the operator. Further, the operatormay be photographed with a camera or the like to enable recognition ofthe operator using the face image of the operator previously stored inthe operator data storage unit 14.

The image storage unit 18 stores a group of images disposed on the albumand available for editing and browse. The images stored in the imagestorage unit 18 each contain such photograph data as a shooting date andtime.

The image selection unit 20 selects from the image storage unit 18 thoseimages that operators can lay out for editing as usable images basedupon the recognition information received from the operator recognitionunit 16 and the photograph data on the images stored in the imagestorage unit 18.

The usable images are selected from the images stored in the imagestorage unit 18 in such a manner that all the images related to anoperator of interest are selected. The related images herein areexemplified by images representing the operator, images related to theimages representing the operator, and images meeting the operator'spreference.

Selection of images representing the operator will be first described.

The image selection unit 20 subjects a group of images stored in theimage storage unit 18 to face extraction processing, and judges theface-extracted images as images that include a person as the subject.

Then, the image selection unit 20 compares the face area of each of theimages judged to include a person and the operator's face imagecontained in the recognition information received from the operatorrecognition unit 16. The comparison of face images may be performed byknown face recognition processing. When the face in the face area of animage and the operator's stored face are of an identical person, theimage is judged to represent the operator and selected to classify itinto a group of usable images that may be used by the operator forarrangement thereof in the album.

Now, a description will be made of the selection of images related tothe images representing the operator and images meeting the operator'spreference.

The image selection unit 20 extracts the images related to the operatorand the images meeting the operator's preference from among the imagesfrom which the face was not extracted in the image selection unit 20according to the operator's preferred image keywords contained in therecognition information received from the operator recognition unit 16and the photograph data on the images stored in the image storage unit18 and selects these images to classify them into a group of usableimages.

Image association will now be described in detail with reference to FIG.3.

In FIG. 3, the images encircled by a solid line are usable images judgedby the image selection unit 20 to include an image representing anoperator A having the recognition information illustrated in FIG. 2, andthus all of the images include the face image of the operator A.

First, the images related to the operator A are extracted using thephotograph data of the images. When the difference between the time atwhich an image that does not include a person was taken and the time atwhich any one of the selected usable images was taken is within a givenrange, the image that does not include a person is judged to be relatedto the operator A, and selected to be classified into a group of usableimages. Given a time difference range of two hours, for example, theimage encircled by an alternate long and short dashed line in FIG. 3 wastaken within only an hour against the image on its left and, thus, isjudged to be related to the operator A and selected to be classifiedinto the operator A's group of usable images.

Next, the images meeting the operator A's preference are extracted usingthe operator A recognition information and the photograph data of theimages stored in the image storage unit 18.

Now, suppose that the operator A recognition information is asillustrated in FIG. 2. The operator A's preferred image keywords are“plants” and “flowers”.

Based upon these keywords, the image selection unit 20 extracts imagesincluding images representing flowers from the images that do notinclude a person, and selects these images to classify them into theoperator A's group of usable images. In FIG. 3, the two images encircledby a dashed line represent flowers with including no person. Theseimages, therefore, are selected to be classified into the operator A'sgroup of usable images.

The preferred image keyword is not limited to the name of a subject, butmay be a color, a figure, and the like. For example, when “pink” isregistered as a keyword, an image with a large pink area may beextracted and selected to be classified into the operator A's group ofusable images based upon the color information that results from imageanalysis.

Image extraction based upon preferred image keywords may be performed byanalyzing images using a known method to specify images based upon thequantity of image characteristics, or by adding scene information orkeywords to each image as tag information in advance at the time theimage is taken and comparing those keywords with the preferred imagekeywords in the recognition information to extract usable images.

Thus, the image selection unit 20 extracts images including an imagerepresenting the operator A, images related to the operator A, andimages meeting the operator A's preference, and automatically selectsthese images to classify them into the operator A's group of usableimages.

The group of usable images may include an image shared by a plurality ofoperators. For example, an image including both the operator A and anoperator B may be selected to be classified into both operator A's andoperator B's groups of usable images, and arranged in the album.

The editing authorization unit 22 automatically specifies the operationinstruction unit 12 (operator) having the right to edit the image dataof an image of interest.

When a plurality of operators edit the same image, operators may giveconflicting editing instructions or one operator's editing may not be inaccordance with editing intended by another operator. Before operatorsstart editing, therefore, the editing authorization unit 22 previouslyspecifies an operator to be authorized to edit a particular image andgrants him/her the right to edit in order to prevent conflict of editinginstructions given by a plurality of operators. When the actual operatorand the holder of the right to edit coincide, the operator can edit theimage data of the image of interest.

The right to edit is automatically granted according to the results ofautomatic image data analysis, the contents of editing, attributes, andthe like. When authorizing editing, one operation instruction unit 12(operator) may be granted the right to edit the image data of oneparticular image or, alternatively, the operator to be granted the rightto edit an image may be determined according to the contents of editingto be made or the part of the image to be edited. How the right to editis granted will be described later in detail.

The editing processor 24 executes processing such as image editing basedupon the right to edit granted by the editing authorization unit 22 tothe operators (operation instruction units 12) according to theinstructions respectively given by the operation instruction units 12.

The monitor 26 displays the images in the album. Further, the monitor 26may display various other items in response to instructions by theediting processor 24 and other units.

One monitor 26 may be provided for one image editing device 10 or onemonitor 26 may be provided for each operation instruction unit 12. Wherea plurality of displays 26 are provided, they all display the samecontents.

Next, the image editing method according to this embodiment will bedescribed referring to FIG. 4.

First, an operator operates the corresponding operation instruction unit12 to transmit the operation instruction unit identification data of theoperation instruction unit 12 to the operator recognition unit 16,requesting album editing to be started (Step S12).

The operator recognition unit 16 acquires information on displayed imageediting instruction and operation instruction unit identification data,searches the operator data storage unit 14 using the acquired operationinstruction unit identification data to acquire from the operator datastorage unit 14 the operator recognition information containing theoperator identification data, the face image, and the like associatedwith the identification information of the operation instruction unit12, and recognizes the operator (step S14).

Then, the operator recognition unit 16 transmits the acquired operatorrecognition information to the image selection unit 20 and the editingauthorization unit 22 (Step S16).

The image selection unit 20 then selects from the image storage unit 18those images that can be displayed on the monitor 26 and edited by anoperator to classify them into a group of the operator's usable imagesbased upon the operator recognition information received from theoperator recognition unit 16 and the photograph data on the images inthe album stored in the image storage unit 18 and extracts the imagedata (Step S18).

The monitor 26 displays as images to be edited the reproduced images ofthe image data selected as usable images by the image selection unit 20(Step S20).

The editing authorization unit 22 determines the right to edit for theoperator at the corresponding operation instruction unit 12 reachingcontents of processing based upon the operator recognition informationreceived from the operator recognition unit 16 and the image analysisresults, contents of editing, and attribute information, etc. of theimage to be edited displayed on the monitor 26, and grants the operatorthe right to edit (step S22). How the right to edit is determined by theediting authorization unit 22 will be described later in detail.

Next, the editing processor 24 executes processing such as editing ofimages based upon the right to edit granted by the editing authorizationunit 22 to the operator (operation instruction unit 12) according to theediting instructions by the operation instruction unit 12 (Step S24).

Thus ends the procedure of the image editing method.

The image editing method of the invention is likewise implemented wherean image to be edited is displayed on the monitor 26.

In this case, an operator first observes an image displayed on themonitor 26, decides what editing to make on the displayed image, andoperates the operation instruction unit 12 to transmit the displayedimage editing instruction information and the operation instruction unitidentification data, which are associated with each other, to theoperator recognition unit 16, whereupon a request is made for editingthe album stored in the image storage unit 18 (Step S12).

The operator recognition unit 16 acquires the displayed image editinginstruction information and the operation instruction unitidentification data, searches the operator data storage unit 14 usingthe acquired operation instruction unit identification data to acquirefrom the operator data storage unit 14 the operator recognitioninformation containing the operator identification data, the face image,and the like associated with the operation instruction unitidentification data, and recognizes the operator (step S14).

Then, the operator recognition unit 16 transmits the acquired operatorrecognition information and the editing instruction information for theimage displayed on the monitor 26 to the editing authorization unit 22(step S16). In the process, the operator recognition information neednot be transmitted to the image selection unit 20 because the monitor 26displays the image to be edited. Even when the operator recognitioninformation is transmitted to the image selection unit 20, the imageselection unit 20 need not select the image of interest as the usableimage.

Next, the editing authorization unit 22 determines the right to edit forthe operator at the corresponding operation instruction unit 12 reachingcontents of processing based upon the operator recognition informationreceived from the operator recognition unit 16 and the image analysisresults, contents of editing, and attribute information, displayed imageediting instruction information from the operator recognition unit 16,etc. and grant the operator the right to edit (step S22).

Next, the editing processor 24 executes processing such as image editingbased upon the right to edit granted to the operator (operationinstruction unit 12) according to the editing instructions from theoperation instruction unit 12 (step S24).

As described above, the monitor 26 first displays an image selected bythe image selection unit 20. Then, the editing authorization unit 22determines the right to edit for operators based upon information on theoperators received from the operator recognition unit 16 and the imageanalysis results, contents of editing, and attribute information, etc.of the displayed image, and grant the operators the right to edit (stepS22).

Now, a detailed description will be made as to how the right to editimage data is determined by the editing authorization unit 22.

First, an example will be described of a method whereby the right toedit is determined based upon the results of automatic image dataanalysis by referring to FIGS. 5A to 5D and 6.

FIG. 5A illustrates an image to be edited; FIGS. 5B to 5D illustrateediting processing that operators are authorized to perform under theirrespective conditions; FIG. 6 is a flow chart illustrating how the rightto edit is determined.

As illustrated in 5A, an image is disposed from among, for example, theoperator A's group of usable images as an image to be edited (step S32in FIG. 6). This image includes the operator A and the operator B assubject of the photograph, with the operator A represented larger.

The editing authorization unit 22 analyzes the image (step S34),determines the person subjects (step S36), and determines the mainsubject, which occupies the largest area among the person subjects (stepS44).

Determining the person subjects in the step S36 may be achieved using amethod employed by the image selection unit 20. For example, the faceimage of each person subject in the displayed image obtained by facerecognition processing is compared with the face images of the operators(step S38) and, when the former coincides with one of the face images ofthe operators (step S40), the person subject is then identified as thatoperator (step S42). Alternatively, information on the subject specifiedby the image selection unit 20 may be temporarily stored and used toidentify the person subjects.

Identification of the person subjects in the step S36 in FIG. 6 isfollowed by automatic determination as to which subject is the mainsubject in the image of interest from the position and the size of thesubjects in the step S44.

In FIG. 5A, both the operators A and B are subjects and because theoperator A is represented larger, the operator A is determined as themain subject.

The editing authorization unit 22 grants the right to edit this image tothe operator A, the main subject. The operator A is granted full rightto edit this image. On the other hand, the operator B is not the mainsubject but a subject in the image. Accordingly, the editingauthorization unit 22 allows the operator B to perform editingprocessing only on the area of the image representing the operator B.

FIGS. 5B to 5D illustrate specific editing items the operators areauthorized to perform.

First, as illustrated in FIG. 5A, when the operator A locates a pointerA.sub.1 for the operation instruction unit 12 in the area of the imagerepresenting the operator A, the operator A, the main subject, isgranted the right to perform all the editing items contained in theediting processing menu illustrated in FIG. 5B (step S40 in FIG. 6) andthus authorized to perform the whole editing processing menu.

On the other hand, when the operator B locates a pointer B.sub.1 in thebackground area of the image illustrated in FIG. 5A, the operator B isnot granted the right to edit and thus not authorized to perform any ofthe editing items in the editing processing menu illustrated in FIG. 5C.Similarly, any operator other than the person subjects is also notgranted the right to edit (step S48 in FIG. 6) and thus not authorizedto perform any of the editing items in the editing processing menu.

When the operator B locates a pointer B.sub.2 in the area of the imagerepresenting the operator B, the operator B is granted the right toperform some of the editing items contained in the editing processingmenu illustrated in FIG. 5D (step S50 in FIG. 6) and thus authorized toperform only some of the items in the editing processing menu.

As regards the unexecutable editing items, not only may the operationsusing the pointer be rendered impossible, a message or the like may bedisplayed to notify the operator that a particular item the operatorattempted to perform is not executable.

Thus, the operator A, the main subject of the image illustrated in FIG.5A, is authorized to freely perform editing processing in the whole areaof this image. On the other hand, the operator B, who is a subject butnot the main subject of this image, is authorized to perform editingprocessing only in the area of the image representing the operator B.Note that, in FIG. 5D, “enlargement,” “reduction,” and “clipping”processings are effected not on a partial area of the image but on thewhole image. Since these processings would also affect the other areasthan that representing the operator B, the operator B is not authorizedto perform these processings.

There is no restriction to the editing items for which the right to editis granted, and they may include image editing and corrections such asred-eye correction, black-and-white processing, sepia processing, andwhite balance setting, addition of comments to the image, image clippingand reduction, and the like. The editing items may also include suchprocessing as clipping, enlargement, and reduction effected on specificsubjects in the image.

When an image is placed in an album, selection of the background colormay be included in the editing items. To print an image on a productsuch as T-shirt, a mug, etc., selection of the color for such a productmay be included in the editing items.

Although, in the above example, the operator identified as the mainsubject in an image is granted full right to edit, the right to edit maybe granted for a page of the album in lieu of for an image. For example,suppose that the main subject is determined for each of a plurality ofimages laid out in a given page of the album, the person represented bya subject who is the main subject in the most of the images in that pagemay be specified as the main subject of that page and granted full rightto edit all the images within that page.

Next, an example will be described of a method whereby the right to editis determined based upon the editing time spent for editing image data.

According to this method, the contents of editing performed and the timespent for editing by the operators thus far using the operationinstruction units 12 are stored in the editing processor 24, forexample. Then, the operator who spent the longest time in a particularediting or the operator who spent the longest time as a whole with allthe editing items considered is granted a specific editing authority orfull right to edit. Conversely, the operator who spent the shortest timein editing may be preferentially given the right to edit.

Further, an example will be described of a method whereby the right toedit is determined based upon the attribute information on image data.

According to this method, an operator who gave an instruction about animage is preferentially given the right to edit. Specifically, anoperator who gave the first instruction about an image is granted fullright to edit that image.

Conversely, the owner of an image, i.e., the operator who uploaded thatimage to the image editing device 10, may be granted full right to editthat image. Since the owner of an image may well be the main subject ofthat image, the operator granted the right to edit that image may wellbe the main subject of that image according to this method.

When a plurality of operators desire to edit the same imagesimultaneously, a single operator at a time may be given the right toedit for a given period of time or until a given quantity of editingprocessing has been performed, thereafter granting one operator afteranother the right to edit in sequence.

The right to edit granted by the above methods may be freely transferredto another operator or waived at the will of the operator having theright to edit. When the right to edit was waived, the editingauthorization unit 22 automatically specifies an operator to be grantedthat right to edit from among the other operators than the one whowaived the right.

When the operators are thus granted their respective rights to edit,they can edit the image within their rights to edit by referring to theimage displayed on the monitor 26.

The right to edit may be determined by one of the methods as deemedoptimum selected from the method based upon automatic image analysis,the method based upon the editing time, and the method based upon theattribute information on the image as described above. Alternatively, ajudgment may be first made as to whether the owner of an image and themain subject thereof coincide based upon the image analysis results andthe attribute information. When the owner and the main subject coincide,the corresponding operator is granted full right to edit. When the ownerand the main subject of the image do not coincide, the personrepresented by the main subject may preferentially be granted full rightto edit.

Thus, according to the image editing device of the invention, theoperator who gives an image editing instruction is automaticallyrecognized, and, furthermore, a judgment is made as to the relationshipbetween the image to be edited and the operator using the image analysisresults, the editing time, the attribute information and the like toautomatically grant operator-specific rights to edit. Thus, even when aplurality of operators edit the same image data or the likesimultaneously, the operators can perform their desired editing as theyare preferentially authorized to edit an image representing them whilestriking a balance between the intentions of one operator who is asubject in the image and of another operator who is another subject inthe image.

The above image editing method of the invention may be recorded in acomputer-readable recording medium as a program for enabling a computerto execute required processing.

While the image editing method and device of the invention has beendescribed above in detail, the present invention is not limited to theabove embodiments and various modifications may be made withoutdeparting from the spirit and scope of the invention.

The invention claimed is:
 1. A computer-implemented method comprising:selecting, by a computer system, an image from a set of images, whereinthe image is editable by a first user and a second user; maintaining, bythe computer system, attribute information about the first user and thesecond user; determining, by the computer system, a first content areaof the image and a second content area of the image based in part on theattribute information, wherein the first content area is larger than thesecond content area and the first content area and the second contentarea can overlap to form an overlapping area; and providing, by thecomputer system, based in part on the attribute information, a firstpermission to allow the first user to edit the first content area and asecond permission to allow the second user to edit the second contentarea, wherein the first permission is based in part on a determinationthat the first user is a main subject of the image based on the firstcontent area being larger than the second content area, and the firstuser and the second user can simultaneously edit the overlapping areabased on the first permission and the second permission.
 2. Thecomputer-implemented method of claim 1, wherein the attributeinformation includes a registered face image associated with the firstuser.
 3. The computer-implemented method of claim 2, further comprising:extracting a face from the image; and identifying an individual in theimage based on the extracted face.
 4. The computer-implemented method ofclaim 3, further comprising comparing the registered face image and theextracted face to determine whether the first user and the individualare an identical person.
 5. The computer-implemented method of claim 4,wherein the providing, based on the attribute information, the firstpermission to allow the first user to edit the first content area of theimage is based on a determination that the first user and the individualare the identical person.
 6. The computer-implemented method of claim 4,wherein the comparing the registered face image and the extracted faceincludes applying face recognition processing.
 7. Thecomputer-implemented method of claim 1, wherein the attributeinformation includes a key word selected by the first user.
 8. Thecomputer-implemented method of claim 7, wherein the providing, based onthe attribute information, the first permission to allow the first userto edit the first content area of the image is based on a determinationthat the image includes a depiction of the key word.
 9. Thecomputer-implemented method of claim 1, wherein the providing, by thecomputer system, based on the attribute information, the firstpermission to allow the first user to edit the first content area of theimage is further based in part on a determination that the first user isthe main subject of the image based on the attribute information. 10.The computer-implemented method of claim 1, further comprisingidentifying a second image to be editable by the first user based on atime associated with the image and a time associated with the secondimage falling within a difference range.
 11. The computer-implementedmethod of claim 1, further comprising prohibiting the second user fromapplying editing processes to the second content area when the editingprocesses affect the first content area.
 12. The computer-implementedmethod of claim 11, wherein the editing processes include at least oneof enlargement, reduction, or clipping.
 13. The computer-implementedmethod of claim 1, wherein the first content area is all of the image.14. The computer-implemented method of claim 1, wherein the secondcontent area is a portion of the image.
 15. The computer-implementedmethod of claim 1, further comprising transferring the first permissionto allow the first user to edit the first content area to another user.16. The computer-implemented method of claim 1, wherein the attributeinformation includes ownership of the image.
 17. Thecomputer-implemented method of claim 1, further comprising allowingsimultaneous editing of the image by the first user and the second user.18. The computer-implemented method of claim 1, further comprisingrequiring sequential editing of the image by the first user and thesecond user.
 19. A computer system comprising: at least one processor;and a memory storing instructions configured to instruct the at leastone processor to perform: selecting an image from a set of images,wherein the image is editable by a first user and a second user;maintaining attribute information about the first user and the seconduser; determining a first content area of the image and a second contentarea of the image based in part on the attribute information, whereinthe first content area is larger than the second content area and thefirst content area and the second content area can overlap to form anoverlapping area; and providing based in part on the attributeinformation, a first permission to allow the first user to edit thefirst content area of the image and a second permission to allow thesecond user to edit the second content area of the image, wherein thefirst permission is based in part on a determination that the first useris a main subject of the image based on the first content area beinglarger than the second content area, and the first user and the seconduser can simultaneously edit the overlapping area based on the firstpermission and the second permission.
 20. A non-transitorycomputer-readable storage medium storing computer-executableinstructions that, when executed, cause a computer system to perform acomputer-implemented method comprising: selecting an image from a set ofimages, wherein the image is editable by a first user and a second user;maintaining attribute information about the first user and the seconduser; determining a first content area and a second content area of theimage based in part on the attribute information, wherein the firstcontent area is larger than the second content area and the firstcontent area and the second content area can overlap to form anoverlapping area; and providing, based in part on the attributeinformation, a first permission to allow the first user to edit thefirst content area of the image and a second permission to allow thesecond user to edit the second content area of the image, wherein thefirst permission is based in part on a determination that the first useris a main subject of the image based on the first content area beinglarger than the second content area, and the first user and the seconduser can simultaneously edit the overlapping area based on the firstpermission and the second permission.